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vln  the  analog  VLSI  implementation  of  neural  systems,  it  is  icmetimes  convenient  to  build 
lateral  inhibition  networks  by  using  a  locally  connected  on-chip  resistive  grid.  A  serious 
problem  of  unwanted  spontaneous  oscillation  often  arises  with  these  circuits  and 
renders  them  unusable  in  practice.  This  paper  reports  a  design  approach  that 
guarantees  such  a  system  will  be  stable,  even  though  the  values  of  designed  elements 
and  parasitics  elements  in  the  resistive  grid  may  be  unknown.  The  method  is  based  on  a 
rigorous,  somewhat  novel  mathematical  analysis  using  Tellegen’s  theorem  and  the  idea 
of  Popov  multipliers  from  control  theory.  It  is  thoroughly  practical  because  the  criteria 
are  local  in  the  sense  that  no  overall  analysis  of  the  interconnected  system  is  required, 
empirical  in  the  sense  that  they  involve  only  measurable  frequency  response  data  on 
the  individual  cells,  and  robust  in  the  sense  that  unmodelled  parasitic  resistances  and 
capacitances  in  the  interconnection  network  cannot  affect  the  analysis. 
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ABSTRACT 

In  the  analog  VLSI  implementation  of  neural  systems,  it  is 
sometimes  convenient  to  build  lateral  inhibition  networks  by  using 
a  locally  connected  on-chip  resistive  grid.  A  serious  problem 
of  unwanted  spontaneous  oscillation  often  arises  with  these 
circuits  and  renders  them  unusable  in  practice.  This  paper  reports 
a  design  approach  that  guarantees  such  a  system  will  be  stable, 
even  though  the  values  of  designed  elements  and  parasitic  elements 
in  the  resistive  grid  may  be  unknown.  The  method  is  based  on  a 
rigorous,  somewhat  novel  mathematical  analysis  using  Tellegen's 
theorem  and  the  idea  of  Popov  multipliers  front  control  theory.  It 
is  thoroughly  practical  because  the  criteria  are  local  in  the  sense 
that  no  overall  analysis  of  the  interconnected  system  is  required, 
empirical  in  the  sense  that  they  involve  only  measurable  frequency 
response  data  on  the  individual  cells,  and  robust  in  the  sense  that 
unmodelled  parasitic  resistances  and  capacitances  in  the  inter¬ 
connection  network  cannot  affect  the  analysis. 

I .  INTRODUCTION 

The  term  "lateral  inhibition"  first  arose  in  neurophysiology  to 
describe  a  common  form  of  neural  circuitry  in  which  the  output  of 
each  neuron  in  sane  population  is  used  to  inhibit  the  response  of 
each  of  its  neighbors.  Perhaps  the  best  understood  example  is  the 
horizontal  cell  layer  in  the  vertebrate  retina,  in  which  lateral 
inhibition  simultaneously  enhances  intensity  edges  and  acts  as  an 
automatic  gain  control  to  extend  the  dynamic  range  of  the  retina 
as  a  whole  .  The  principle  has  been  used  in  the  design  of  artificial 
neural  system  algorithms  by  Kohonen^  and  others  and  in  the  electronic 
design  of  neural  chips  by  Carver  Mead  et.  al.3«4. 

In  the  VLSI  implementation  of  neural  systems*,  it  is  convenient 
to  build  lateral  inhibition  networks  by  using  a  locally  connected 
on-chip  resistive  grid.  Linear  resistors  fabricated  in,  e.g., 
polysilicon,  yield  a  very  conpact  realization,  and  nonlinear 
resistive  grids,  made  fron  MOS  transistors,  have  been  found  useful 
for  image  segmentation.4 *5  Networks  of  this  type  can  be  divided  into 
two  classes:  feedback  systems  and  feedforward-only  systems.  In  the 
feedforward  case  one  set  of  amplifiers  imposes  signal  voltages  or 


currents  on  the  grid  and  another  set  reads  out  the  resulting  response 
for  subsequent  processing,  while  the  same  amplifiers  both  "write"  to 
the  grid  and  "read"  from  it  in  a  feedback  arrangement.  Feedforward 
networks  of  this  type  are  inherently  stable,  but  feedback  networks 
need  not  be . 

A  practical  example  is  one  of  Carver  Mead's  retina  chips3  that 
achieves  edge  enhancement  by  means  of  lateral  inhibition  through  a 
resistive  grid.  Figure  1  shows  a  single  cell  in  a  continuous-time 
version  of  this  chip.  Note  that  the  capacitor  voltage  is  affected 
both  by  the  local  light  intensity  incident  on  that  cell  and  by  the 
capacitor  voltages  on  neighboring  cells  of  identical  design.  Any 
cell  drives  its  neighbors,  which  drive  both  their  distant  neighbors 
and  the  original  cell  in  turn.  Thus  the  necessary  ingredients  for 
instability — active  elements  and  signal  feedback — are  both  present 
in  this  system,  and  in  fact  the  continuous-time  version  oscillates 
so  badly  that  the  original  design  is  scarcely  usable  in  practice 
with  the  lateral  inhibition  paths  enabled.  Such  oscillations  can 


incident 
1  iqh  t 


Figure  1.  This  photoreceptor  and  signal  processor  circuit,  using  two 
MOS  transconductance  amplifiers,  realizes  lateral  inhibition  by 
communicating  with  similar  units  through  a  resistive  grid. 


readily  occur  in  any  resistive  grid  circuit  with  active  elements  and 
feedback,  even  when  each  individual  cell  is  quite  stable.  Analysis 
of  the  conditions  of  instability  by  straightforward  methods  appears 
hopeless,  since  any  repeated  array  contains  many  cells,  each  of 
which  influences  many  others  directly  or  indirectly  and  is  influenced 
by  them  in  turn,  so  that  the  number  of  simultaneously  active  feed¬ 
back  loops  is  enormous. 

This  paper  reports  a  practical  design  approach  that  rigorously 
guarantees  such  a  system  will  be  stable.  The  very  simplest  version 
of  the  idea  is  intuitively  obvious:  design  each  individual  cell  so 
that,  although  internally  active,  it  acts  like  a  passive  system  as 


seen  from  the  resistive  grid.  In  circuit  theory  language,  the 
design  goal  here  is  that  each  cell's  output  impedance  should  be  a 
positive- real"}  function.  This  is  sometimes  not  too  difficult  in 


practice?  we  will  show  that  the  original  network  in  Fig.  1  satisfies 


this  condition  in  the  absence  of  certain  parasitic  elements.  More 


important,  perhaps,  it  is  a  condition  one  cam  verify  experimentally 


by  frequency- response  measurements. 

It  is  physically  apparent  that  a  collection  of  cells  that 
appear  passive  at  their  terminals  will  form  a  stable  system  when 
interconnected  through  a  passive  medium  such  as  a  resistive  grid. 

The  research  contributions,  reported  here  in  summary  form,  are 
i)  a  demonstration  that  this  passivity  or  positive-real  condition 
is  much  stronger  than  we  actually  need  and  that  weaker  conditions, 
more  easily  achieved  in  practice,  suffice  to  guarantee  stability  of 
the  linear  network  model,  and  ii)  an  extension  of  i)  to  the  nonlinear 
domain  that  furthermore  rules  out  large-signal  oscillations  under 
certain  conditions. 


II.  FIRST-ORDER  LINEAR  ANALYSIS  OF  A  SINGLE  CELL 


We  begin  with  a  linear  analysis  of  an  elementary  model  for  the 
circuit  in  Fig.  1.  For  an  initial  approximation  to  the  output 
admittance  of  the  cell  we  simplify  the  topology  (without  loss  of 
relevant  information)  and  use  a  naive'  model  for  the  transconductance 
amplifiers,  as  shown  in  Fig.  2. 


Figure  2.  Simplified  network  topology  and  transconductance  amplifier 
model  for  the  circuit  in  Fig.  1.  The  capacitor  in  Fig.  1  has  been 
absorbed  into  C, 
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Straightforward  calculations  show  that  the  output  admittance  is 
given  by 

-1  9mT.9m2R0]. 
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This  is  a  positive-real,  i.e.,  passive,  admittance  since  it  can  always 
be  realized  by  a  network  of  the  form  shown  in  Fig.  3,  where 
-1,-1  —  .  .-1 


R1  *  ^m2+  Ro2>  *  r2-  (gmi5m2Ro1>  ,  and  L  *  C0l/gmigm2. 

Although  the  original  circuit  contains  no  inductors,  the 
realization  has  both  capacitors  and  inductors  and  thus  is  capable 
of  damped  oscillations.  Nonetheless,  if  the  transamp  model  in 
Fig.  2  were  perfectly  accurate,  no  network  created  by  interconnecting 
such  cells  through  a  resistive  grid  (with  parasitic  capacitances) 
could  exhibit  sustained  oscillations.  For  element  values  that  may 
be  typical  in  practice,  the  model  in  Fig.  3  has  a  lightly  daaped 
resonance  around  1  KHz  with  a  Q  *  10.  This  disturbingly  high  Q 
suggests  that  the  cell  will  be  highly  sensitive  to  parasitic  elements 
not  captured  by  the  simple  models  in  Fig.  2.  Our  preliminary 


Figure  3-  Passive  network  realization  of  the  output  admittance  (eq. 
(1)  of  the  circuit  in  Fig.  2. 

analysis  of  a  much  more  complex  model  extracted  from  a  physical 
circuit  layout  created  in  Carver  Mead's  laboratory  indicates  that 
the  output  impedance  will  not  be  passive  for  all  values  of  the  trans¬ 
amp  bias  currents.  But  a  definite  explanation  of  the  instability 
awaits  a  more  careful  circuit  modelling  effort  and  perhaps  the  design 
of  an  on-chip  impedance  measuring  instrument. 

III.  POSITIVE-REAL  FUNCTIONS,  S-POSITIVE  FUNCTIONS,  AND 
STABILITY  OF  LINEAR  NETWORK  MODELS 

In  the  following  discussion  s  =  3+ju  is  a  complex  variable, 

H (s)  is  a  rational  function  (ratio  of  polynomials)  in  s  with  real 
coefficients,  and  we  assume  for  simplicity  that  H(s)  has  no  pure 
imaginary  poles.  The  term  closed  right  half  plane  refers  to  the  set 
of  complex  numbers  s  with  Re{s}  _>  0. 

Def.  1 

The  function  H(s)  is  said  to  be  positive-real  if  a)  it  has  no 
poles  in  the  right  half  plane  and  b)  Re{H(jw)}  >  0  for  all  uj. 

If  we  know  at  the  outset  that  H(s)  has  no  right  half  plane  poles, 
then  Def.  1  reduces  to  a  simple  graphical  criterion:  H(sJ  is  positive- 
real  if  and  only  if  the  Nyquist  diagram  of  H(s)  (i.e.  the  plot  of 
H(jw)  for  id  >  0,  as  in  Fig.  4)  lies  entirely  in  the  closed  right  half 
plane . 

Note  that  positive-real  functions  are  necessarily  stable  since 
they  have  no  right  half  plane  poles,  but  stable  functions  are  not 
necessarily  positive-real ,  as  Example  1  will  show. 

A  deep  link  between  positive  real  functions ,  physical  networks 
and  passivity  is  established  by  the  classical  result'  in  linear 
circuit  theory  which  states  that  H(s)  is  positive-real  if  and  only  if 
it  is  possible  to  synthesize  a  2-terrainal  network  of  positive  linear 
resistors,  capacitors,  inductors  and  ideal  transformers  that  has  H(s) 
as  its  driving-point  impedance  or  admittance. 


Def .  2 


The  function  H(s)  is  said  to  be  9-positive  for  a  particular  value 
of  9(9  *  0,  d  ?  i) ,  if  a)  H (s)  has  no  poles  in  the  right  half  plane, 
and  b)  the  Nyquist  plot  of  H(s)  lies  strictly  to  the  right  of  the 
straight  line  passing  through  the  origin  at  an  angle  9  to  the  real 
positive  axis. 

Note  that  every  9-positive  function  is  stable  and  any  function 
that  is  8-positive  with  9  =  -/ 2  is  necessarily  positive-real. 


Figure  4.  Nyquist  diagram  for  a  function  that  is  9-positive  but 
not  positive- real . 

Example  1 

The  function 


.  (s+1) (s+40) 

W  (s+5) (s+6) (s+7)  (2) 

is  9-positive  (for  any  9  between  about  18°  and  68°)  and  stable,  but  it 
is  not  positive-real  since  its  Nyquist  diagram,  shown  in  Fig.  4, 
crosses  into  the  left  half  plane. 

The  importance  of  8-positive  functions  lies  in  the  following 
observations:  1)  an  interconnection  of  passive  linear  resistors  and 
capacitors  and  cells  with  stable  linear  impedances  can  result  in  an 
unstable  network,  b)  such  an  instability  cannot  result  if  the 
impedances  are  also  positive-real ,  c)  9-positive  impedances  form  a 
larger  class  than  positive-real  ones  and  hence  9-positivity  is  a  less 
demanding  synthesis  goal,  and  d)  Theorem  1  below  shows  that  such  an 
instability  cannot  result  if  the  impedances  are  6-positive,  even  if 
they  are  not  positive-real. 

Theorem  1 


Consider  a  linear  network  of  arbitrary  topology,  consisting  of 
any  number  of  passive  2-terminal  resistors  and  capacitors  of  arbitrary 
value  driven  by  any  number  of  active  cells.  If  the  output  impedances 


of  all  the  active  cells  are  6-positive  for  scxne  common  9,  O<0<  -j, 
then  the  network  is  stable.  4 

The  proof  of  Theorem  1  relies  on  Lemma  1  below. 

Lemma  1 


If  H  (s)  is  0-positive  for  some  fixed  9,  then  for  all  sQ  in  the 
closed  first  quadrant  of  the  complex  plane,  H(s0)  lies  strictly  to 
the  right  of  the  straight  line  passing  through  the  origin  at  an  angle 
9  to  the  real  positive  axis,  i.e.,  Re{s0}  ^  0  and  Im{s0)  >_  0  ="> 

9-t  <  j_  H  (sQ)  <  5 . 

Proof  of  Lemma  1  (Outline) 


Let  d  be  the  function  that  assigns  to  each  s  in  the  closed  right 
half  plane  the  perpendicular  distance  d(s)  from  H(s)  to  the  line 
defined  in  Def.  2.  Note  that  d(s)  is  harmonic  in  the  closed  right 
half  plane,  since  H  is  analytic  there.  It  then  follows,  by  application 
of  the  maximum  modulus  principle8  for  harmonic  functions,  that  d  takes 
its  minimum  value  on  the  boundary  of  its  domain,  which  is  the 
imaginary  axis.  This  establishes  Lemma  1. 

Proof  of  Theorem  1  (Outline) 


The  network  is  unstable  or  marginally  stable  if  and  only  if  it 
has  a  natural  frequency  in  the  closed  right  half  plane,  and  sQ  is  a 
natural  frequency  if  and  only  if  the  network  equations  have  a  nonzero 
solution  at  sQ.  Let  {i^}  denote  the  complex  branch  currents  of  such 
a  solution.  By  Tellegen's  theoren?the  sum  of  the  complex  powers 
absorbed  by  the  circuit  elements  must  vanish  at  such  a  solution,  i.e., 
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resistances 


capacitances 


'/s  C.  + 
o  k 
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cell 
terminal  pairs 


0, 


(3) 

where  the  second  term  is  deleted  in  the  special  case  so*0,  since  the 
conplex  power  into  capacitors  vanishes  at  so*0. 

If  the  network  has  a  natural  frequency  in  the  closed  right  half 
plane,  it  must  have  one  in  the  closed  first  quadrant  since  natural 
frequencies  are  either  real  or  else  occur  in  complex*  conjugate  pairs. 

But  (3)  cannot  be  satisfied  for  any  sQ  in  the  closed  first  quadrant, 
as  we  can  see  by  dividing  both  sides  of  (3)  by  ^  |lk|  ,  where  the 

sum  is  taken  over  all  network  branches.  After  this  division,  (3) 
asserts  that  zero  i3  a  convex  combination  of  terms  of  the  form  , 
terms  of  the  form  (Cvs0)~l,  and  terms  of  the  form  Zk(so). 

Visualize  where  these  terms  lie  in  the  complex  plane:  the  first  set  lies 

on  the  real  positive  axis,  the  second  set  lies  in  the  closed  4-th 
quadrant  since  sQ  lies  in  the  closed  1st  quadrant  by  assumption,  and 
the  third  set  lies  to  the  right  of  a  line  passing  through  the  origin 
at  an  angle  9  by  Lemma  1.  Thus  all  these  terms  lie  strictly  to  the 
right  of  this  line,  which  implies  that  no  convex  combination  of  them 
can  equal  zero.  Hence  the  network  is  stable! 


IV.  STABILITY  RESULT  FOR  NETWORKS  WITH  NONLINEAR 
RESISTORS  AND  CAPACITORS 

The  previous  result  for  linear  networks  can  afford  some  limited 
insight  into  the  behavior  of  nonlinear  networks.  First  the  nonlinear 
equations  are  linearized  about  an  equilibrium  point  and  Theorem  1  is 
applied  to  the  linear  model.  If  the  linearized  model  is  stable,  then 
the  equilibrium  point  of  the  original  nonlinear  network  is  locally 
stable,  i.e.,  the  network  will  return  to  that  equilibrium  point  if 
the  initial  condition  is  sufficiently  near  it.  But  the  result  in  this 
section,  in  contrast,  applies  to  the  full  nonlinear  circuit  model  and 
allows  one  to  conclude  that  in  certain  circumstances  the  network 
cannot  oscillate  even  if  the  initial  state  is  arbitrarily  far  from 
the  equilibrium  point. 

Def.  3 


A  function  H(s)  as  described  in  Section  III  is  said  to  satisfy 
the  Popov  criterion^®  if  there  exists  a  real  number  r>0  such  that 
Re{  (1+juir)  H(jai)  }  ^  0  for  all  w. 

Note  that  positive  real  functions  satisfy  the  Popov  criterion 
with  r=>0.  And  the  reader  can  easily  verify  that  G(s)  in  Example  1 
satisfies  the  Popov  criterion  for  a  range  of  values  of  r.  The  important 
effect  of  the  term  (1+jwr)  in  Def.  3  is  to  rotate  the  Nyquist  plot 
counterclockwise  by  progressively  greater  amounts  up  to  90°  as  w 
increases. 

Theorem  2 


Consider  a  network  consisting  of  nonlinear  2-terminal  resistors 
and  capacitors,  and  cells  with  linear  output  impedances  Z^fs).  Suppose 

i)  the  resistor  curves  are  characterized  by  continuously 

differentiable  functions  i^  *  g^v^)  w*iere  9^(0)  =  0  and 
0  <  <  G  <  «  for  all  values  of  k  and  vk, 

ii)  the  capacitors  are  characterized  by  ik  ■  ck(vk>vk 

0  <  <  Cjjtv^)  <  ®  for  all  values  of  k  and  v^, 

iii)  the  impedances  Z^(s)  have  no  poles  in  the  closed  right 
half  plane  and  all  satisfy  the  Popov  criterion  for  some  common 
value  of  r. 


If  these  conditions  are  satisfied,  then  the  network  is  stable  in  the 
sense  that,  for  any  initial  condition, 


l 

all  branches 


dt  < 


(4) 


The  proof,  based  on  Tellegen's  theorem,  is  rather  involved.  It 
will  be  omitted  here  and  will  appear  elsewhere. 
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